Digital cinema test signal

ABSTRACT

A technique for managing the production, post-production and distribution of audio-visual projects permits accurate management of production values and thereby allows accurate and measurable reproduction and control. Test signal data is used to assist the operator in insuring the levels are set to the intended display characteristics in the event that factors such as creative lighting or applied effects affect the desired look of the scene. The test signal data may encompass elements that determine resolution, white level, black level, grey steps, frequency response and linearity as well as sound parameters. Chroma channels may exhibit similar signals including a bar pattern that can be used to insure the best colorimetry is maintained. Standard signals may also improve compositing and cross media transfers for matching production values.

RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.09/714,599, filed on Nov. 15, 2000, currently pending, which in turnclaims priority to U.S. provisional patent application Ser. No.60/165,740 filed Nov. 15, 1999, and U.S. provisional patent applicationSer. No. 60/188,969 filed Mar. 10, 2000, and U.S. provisional patentapplication Ser. No. 60/227,672 filed Aug. 24, 2000. The foregoingapplications are hereby incorporated by reference as if set forth fullyherein.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates to reference information included in captureddigital signals, and more specifically to a digital referenceinformation providing a baseline for determining and measuring audio andvideo signal changes in the post production and display processes.

2. Description of the Prior Art

The move to capture images electronically for cinema productions closelyresemble the evolution of television production moving from film tovideo based capture technologies. Tools developed for both film andvideo provided the post production processes the ability to restore theoriginal look of the scene by using various tools and procedures. Forthe film production, a color chart was photographed at the head of eachscene to assist in color balance during the film to tape transfer. Videoproductions may use a color bar reference at the head of the programmaterial to assist in proper set-up of playback levels. Both systems maywork for the intended media.

Unlike film, an electronic camera offers the ability to see the resultimmediately on a picture monitor. Observing recent productions, setlighting and aperture were adjusted based on the image that wasdisplayed on a waveform and picture monitor near the camera. Upon beingsatisfied that the scene was “correct”, the production would proceed andthe image recorded on a High Definition Tape recorder. What may beimportant to the director and cinematographer as far as subtle detail inthe shadows and lace curtains in a window may be overlooked in latersteps of postproduction. Rarely will both detail in shadows, and detailin backlit windows survive together, either one or the other arenormally clipped during the post process. But what is needed is testsignal data that may reside along with the active picture and or sounddata that may identify benchmark image or sound characteristics.

SUMMARY OF THE INVENTION

The present invention may provide a technique for managing theproduction, post-production and distribution of audio-visual projects topermit accurate management of production values to enable accurate andmeasurable control. Test signal data may assist the operator in insuringthe levels are indeed set to the intended look in the event of anycreative lighting applied or effects used that would create an unnaturallook to the scene. The test signal data may encompass elements thatdetermine resolution, White level, Black level, Grey steps, Frequencyresponse and linearity as well as sound parameters. Chroma channels mayexhibit similar signals including a bar pattern that can be used toinsure the best colorimetry is maintained. Standard signals may alsoimprove compositing and cross media transfers without extraordinaryefforts to match production values.

In another aspect of the present invention, a test signal may beinserted on an active but unused line of video to track and monitor thevideo image's signal level and quality throughout the mastering andreplication process. The image quality is therefore measurable byreferencing this signal. This same model can be applied to audio andDigital Cinema.

When capturing an image with a digital cinema camera, test signal datacan be inserted and recorded along with the active picture and sound.This test signal data may serve as a reference for the sound and picturequality and associated technical parameters. The post production processmay involve such things as “timing” or changes to color balance andcomponent signal levels in order to produce finely tuned images andsound. At any time throughout the production and post-productionprocesses, one can return a scene to the original image capture levelsby referencing the test signal data and adjusting levels to theiroriginal state. For scenes used in special effects, the test signal datacan be used to control levels and maintain continuity between likescenes and composited images. Certain automated functions could beimplemented in conjunction with the test signal data in much the sameway as VIRS works in consumer television today to control signal levelsbetween the origination site and the local broadcast station.

Applications of this test signal data in the creation of the digitalmaster may include:

-   -   Creation of the High Definition or Super High Definition Digital        Master;    -   From Digital source to Digital    -   From Digital source to Film    -   From Film source to Digital

It should be possible to integrate the test signal data generator intothe recording device on the set, therefore eliminating the need for aseparate piece of equipment to generate the test signal data.

In a still further aspect of the present invention, test signals may beadded to entertainment distributions such as analog media, digital mediaand optical media. The test signals may be used to align the homeentertainment system of a user to reproduce the intended theatricalperformance.

In another still further aspect of the present invention, test signaldata may be added to entertainment venue distributions using analogmedia, digital media and transmissions, and optical media andtransmissions however distributed. The test signal data may be used toalign the venue entertainment system to reproduce the intendedperformance and one or more feedback channels may provide thedistributor or creator information or control of the characteristics ofa performance.

These and other features and advantages of this invention will becomefurther apparent from the detailed description and accompanying figuresthat follow. In the figures and description, numerals indicate thevarious features of the invention, like numerals referring to likefeatures throughout both the drawings and the description.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a test signal system according to thepresent invention.

FIG. 2 is a detail block diagram of a test signal system input accordingto the present invention.

FIG. 3 is graph of a test signal according to the present invention.

FIG. 4 is a detail block diagram of a test signal system outputaccording to the present invention.

FIG. 5 is a block diagram of a home entertainment system according tothe present invention.

FIG. 6 is a test election menu according to the present invention.

FIG. 7 is a test selection menu according to the present invention.

FIG. 8 is an aspect test window according to the present invention.

FIG. 9 is a tint and color test window according to the presentinvention.

FIG. 10 is a speaker phase test window according to the presentinvention.

FIG. 11 is a speaker phase diagnostic window according to the presentinvention.

FIG. 12 is a second speaker phase diagnostic window according to thepresent invention.

FIG. 13 is a block diagram of a currently preferred embodiment of thepresent invention.

FIG. 14 is a sample graph of image density to exposure.

FIG. 15 is a block diagram of the present invention showing the stepsfrom conventional image storage to DIME files and back to conventionalimage storage.

FIG. 16 is a block diagram of an alternate embodiment of the presentinvention.

FIG. 17 is a block diagram of the steps of the present invention showingthe process of simulation of a target image format.

FIG. 18 is a block diagram of the output and simulation steps of thepresent invention.

FIG. 19 is a block diagram of the process steps of the presentinvention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT(S)

Referring now to FIG. 1, a digital cinema system 10 according to thepresent invention may include image capture device 12 which may produceimage data 13 which may also include test data 15. Image data 13 may beused directly in post-production 17 or it may be included with test data15 which may be produced by image capture device 12 or stand alone testdata generator 26. Image data 13 and test data 15 comprise enhanced data19. Enhanced data 19 may be used in post-production 17 to allow greatercontrol during production of final content 28. Images such as imageinput 22 may be manipulated by post production 17 using test data 15 toprovide a base line for original image characteristics 22A. Finalcontent 28 may be distributed by distribution 29. Distribution channel29A may be directed to provide final content 28 through film 29F,magnetic media 29M, or optical media 29P. Additionally, distributionchannel 29B may be directed to provide final content 28 throughsatellite link 29S, broadcast link 29L, or cable link 29C. Distributionchannel 29B may also provides a two-way link 29T through eachdistribution channel providing a feedback channel for feedback signal87.

Final content 28 shown in FIG. 1 may be provided to distribution outlet90 through two-way link 29T. Final content 28 may be provided toprojector 80 for display on screen 83. Sound component 28S of finalcontent 28 may be provided to sound network 84 that may includeindividual sound reproduction devices 86. Distribution outlet 90 mayalso include feedback sensor 92 to monitor displayed images 82 and orreproduced sound 88.

Referring to FIG. 2, a digital cinema input system 10A according to thepresent invention may include digital image capture device 12 and testsignal 14. Test signal 14 may be added to conventional video signal 16by signal generator 18 included within image capture device 12. Testsignal 14 may enable optimization of image input 22. Because test signal14 is added to video signal 16 at or immediately after image capturepoint 24, subsequent changes to original image signal may be quantifiedand or eliminated. Signal generator 18 may also be a stand alone deviceor it may also be included in a conventional device along data stream20. Test signal 14 may also include information on image capture device12 such as characteristics of optics 12A or video chip 12B or of imagesoftware 12C.

Referring now to FIG. 3, test signal 14 may be included in verticalblanking elements 30 of composite signal 32. Signal 32 may be an NTSC orHDTV or similar signal. In another aspect of the present invention, testsignal 14 may use available bandwidth 34 of video signal 36. Test signal14 may also comprise one or more file elements of a digital image file.

FIG. 4 depicts a preferred embodiment of the present invention,comprising a digital image projector 80 projecting projected images 81onto screen 83 to be reflected as images 82 to be viewed by a viewer(not shown). Screen 83 may be any type of screen known in the art,including the type used in commercial movie theaters, conference halls,or home theaters.

Projector 80 may include controller 98 to receive image data signal 99.Controller 98 may be comprised of software, hardware, or a combinationof software and hardware. Furthermore, an analog to digital converter isrequired to digitize the feedback sensor 92 (see discussion below)output voltage for analysis. Image data signal 99 may include image data91 and metadata 93. Metadata 93 may include information regarding theimage data, including color, luminance, and brightness information, thatdefines the proper display parameters for the image data. Metadata 93may be combine with image data 91 to form image data signal 99 duringthe recording process, or later during the mastering process or evenprior to transmitting the image data to projector 80 for display. Thepurpose of the metadata is to provide a baseline reference against whichimages 82 as actually presented to a viewer can be compared.

The metadata may include further information, such as informationuniquely identifying the images (e.g. movie) being displayed, the sourceof the images, the intended receiver of the images, and payment or othertransactional and/or financial information. The metadata may alsoinclude information identifying predefined characteristics, such as aparticular color space, to properly display image data 91 so as togenerate displayed images 82 as originally intended by the creator ofthe images (e.g. film director).

Controller 98 receives image data signal 99 and extracts and separatesimage data 91 and metadata 93. Projector 80 may further include imageadjuster 94 to adjust image data 91 in accordance with metadata 93.Image adjuster 94 may be comprised of a software, hardware, orcombination software/hardware digital matrix to manipulate the imagedata in accordance with the metadata to create images 81.

Projector 80 may further include conversion tables 96. The conversiontables may contain different predefined color profiles to adjustincoming image data 91 in accordance with a particular, pre-selectedpurpose. Thus, conversion tables 96 may contain color profiles definingdifferent color spaces within which image data 91 may have beenoriginally created. The conversion tables may further contain colorprofiles defining different “moods” or other image characteristics thatcan be used to ensure that displayed images 82 have the look originallyintended by the creator of image data 91, and thus provide for a methodto ensure the preservation of the artistic integrity and intent of theimage data. One additional possible use of the conversion tables is toprovide for different uses of the display venue (movie theater,auditorium, bar/dance club, home theater), e.g. contain differentsettings for displaying movies, video clips during a presentation,videos during a party, etc. Conversion tables 96 are thus not limited tocontaining solely color information, but may also contain, among otherinformation, luminance and light level settings, as well as informationrelating to settings within the venue such as ambient light settings.

Conversion tables 96 may also contain information related to processingthe sound tracks included in image data 91. Thus, in an alternativeembodiment, a hardware or software-based utility may be provided thatuses real-time or off-line analysis of the data stream, or data encodedduring program origination, to provide a control signal to set the gain,or restrict the bandwidth of the audio tracks, so that audibledistortion or damage to the amplifier or speakers at high listeninglevels is prevented. This feature is thought to be especially attractiveand useful within a home theater setting.

Referring now to FIG. 4, projector 80 may further include feedbacksensor 92 to detect displayed images 82 as actually reflected by screen83, and thus as actually seen by a viewer seated in the venue andwatching the images on the screen. In its simplest implementation, thefeedback sensor can be a single element photo-sensor 92A (CCD orphoto-diode) with a simple lens 92B such that the sensor only sees theprojection screen. The entire screen can be illuminated for measurementsthat would reflect the performance of the entire screen on the average.However, feedback sensor 92 may be comprised of any otherlight-detecting device as known in the art. The feedback sensor may becolor-sensitive, and may thus be comprised of a plurality of photocells,each such photocell adjusted to detect one color. Thus, in oneembodiment, the feedback sensor may comprise a number of photocells fordetecting each of the primary colors, respectively. In anotherembodiment, feedback sensor 92 may comprise a plurality of photocells,each of which is oriented so as to detected images 82 as reflected byseparate, individual sections of screen 83. In this embodiment, feedbacksensor 92 may be used to detect variations across the screen.

The feedback sensor, however, may also be a broadband luminance sensornot sensitive to the color of the projected light. The light generatedby the projector is composed of Red, Green, and Blue elements, each ofwhich can be shown sequentially. In this method of use, the feedbacksensor can measure the light level for each color individually.Subsequent software can calculate the appropriate corrections to beapplied to make the projector meet the desired color standard.

Conversely, the screen can be illuminated over distinct portions of theentire screen, so that measurements would characterize the uniformity ofscreen performance over its entire area. This would allow us to measureshading errors or light falloff on the sides, for instance. It isnecessary to generate a test signal for each area that can be related tothe sensor measurement at that time. The sensor is not spatiallysensitive; the analysis software only knows a specific area because thetest signal and the light measurement occurred at the same time.

Resolution can also be measured with a single pixel feedback sensor. Atest signal with small detail can be projected that may only appear onthe screen if the projector lens is in focus. If projector 80 is out offocus, the small detail will not appear and the screen will be darker.The invention thus also provides a method for adjusting the focus of aprojector's lens, which can also be accomplished remotely.

Feedback sensor 92 may also include multi-channel capability such as acombination of video and audio channels.

The feedback sensor is preferably attached to the projector to form aunitary structure therewith, but may also be physically separate andapart from the projector. When the feedback sensor is positioned at theprojector, it measures the reflected light from the screen, includingthe effects of the projection booth port glass and the screen itself.This may be of importance because glass can contain color that maychange the spectrum of light passing through it, and theatre screens mayturn yellow and darken with age. Anything else in the light path, suchas the projection lens itself, may also be taken into account.

Feedback sensor is placed and oriented so as to detect displayed images82 as reflected off screen 83 and thus as actually seen by a viewerseated in the venue. The feedback sensor may provide feedback signal 87to image adjuster 94 in response to detecting images 82. Image adjuster94 may further adjust image data 91 in accordance with feedback signal87 to account for characteristics of the projector and venue, and thusoffset changes to projected images 81 caused by the projector itself, orchanges to the reflected images 122 caused by the screen, ambientlighting in the venue, etc.

Projector 80 may also include communication link 85 to transmit feedbacksignal 87. Communication link 85 may comprise a modem and a telephoneline, a dedicated ISDN line, a TCP/IP link, or any other type ofcommunication link known in the art. The feedback signal may thus beprovided to a remote site for monitoring the quality of the displayedimages. Further possible uses of the feedback signal may be to ensureaccountability of the venue operator by verifying, for example, that theproper movie is shown at the scheduled times, etc. In this manner, movietheatre owners may also remotely verify the consistency of image qualityamong all of their theaters, and may ascertain the need for equipmentmaintenance or repair at any one of the particular theaters.

Also in response to the feedback signal, image data signal 99 may beadjusted by, for example, specifying a different conversion table 96 tobe used to adjust image data 91. Additionally, if none of the conversiontables residing in projector 80 can properly adjust image data 91, acustom conversion table may be provided to the projector viacommunication link 85. In one embodiment of the invention, image datasignal 99 is also provided to projector 80 via communication link 85,and may thus be provided in real time at the scheduled time fordisplaying the images (e.g. movie) or downloaded just prior to thescheduled performance. In such an embodiment, a custom conversion tablemay be incorporated into metadata 93, or simply added to image data 91in addition to metadata 93, and may then be extracted by controller 98from image data signal 91 and provided to image adjuster 94.

The ability to provide custom conversion tables may also greatly reduceor eliminate altogether the need for field technicians to visit thevenue to adjust the projector. Thus, in one method of use of theinvention, a series of tests may be conducted on projector 80 at anydesired frequency (e.g. daily, weekly, etc.) and an appropriate set ofconversion tables 96 downloaded for later use in adjusting image data 91in accordance with detected characteristics of the projector, thescreen, and the venue. The test or tests may rely on the feedback sensor92 to provide feedback signal 87 to a remote location where the currentcharacteristics of the projector are determined from the informationcontained in the feedback signal, the known image data provided for thetests, and the differences therebetween. In one embodiment, the testsimply consists of displaying the image data 91. In another embodiment,specialized images such as monochromatic shapes may be displayed onvarious portions of screen 83, to measure the response to differentcolors as well any variations across the screen. Additionally, asmentioned previously, tests may be run displaying single pixels todetermine if the projector is focused properly onto the screen. Anyother of a number of tests may also be employed with feedback sensor 92.

In a further use of the invention, a system is provided for managing theproduction and distribution of digital cinema projects to permitaccurate management of production values to enable accurate andmeasurable control. Thus, metadata 93 may include a test signal toassist the projector operator in insuring the projector is indeed set tothe intended look in the event of any creative lighting applied oreffects used that would create an unnatural look to the scene. The testsignal may encompass elements that determine White level, Black level,Grey steps, Frequency response and linearity as well as soundparameters. Chroma channels may exhibit similar signals including a barpattern that can be used to insure the best colorimetry is maintained.

The test signal may be inserted on an active but unused line of video totrack and monitor the video image's signal level and quality throughoutthe mastering and replication process. The image quality is thereforemeasurable by referencing this signal. This same model can be applied toaudio and digital cinema.

When capturing an image with a digital cinema camera, test signal datacan be inserted and recorded along with the active picture and sound.This test signal data may serve as a reference for the sound and picturequality and associated technical parameters. The post production processmay involve such things as “timing” or changes to color balance andcomponent signal levels in order to produce finely tuned images andsound. At any time throughout the production and post-productionprocesses, one can return a scene to the original image capture levelsby referencing the test signal data and adjusting levels to theiroriginal state. For scenes used in special effects, the test signal datacan be used to control levels and maintain continuity between likescenes.

Applications of this test signal data in the creation of the digitalmaster may include:

-   -   Creation of the High Definition or Super High Definition Digital        Master;    -   From Digital source to Digital;    -   From Digital source to Film; and    -   From Film source to Digital.

The test signal data generator may also be incorporated into theaudio/visual capture device on the set, therefore eliminating the needfor a separate piece of equipment to generate the test signal data.

In a still further aspect of the present invention, test signals may beadded to entertainment distributions such as analog media, digital mediaand optical media. The test signals may be used to align the homeentertainment system of a user to reproduce the intended theatricalperformance.

In another still further aspect of the present invention, test signaldata may be added to entertainment venue distributions using analogmedia, digital media and transmissions, and optical media andtransmissions however distributed. The test signal data may be used toalign the venue entertainment system to reproduce the intendedperformance and one or more feedback channels may provide thedistributor or creator information or control of the characteristics ofa performance.

Although the above embodiments have been described within the context ofa movie theater, it must be understood that the inventive conceptpresented herein may be equally applicable to any other venue whereinimages and sounds are presented in response to digital data input. Thus,a system according to the present invention may be an information-basedtechnology that enables optimum playback of digitally encoded audio andvideo for both the home and cinema. The present inventive techniqueachieves this by means of information provided by data pre-encoded atthe time of origination, or from post analysis of the audio and videodata-streams (real-time or off-line). The methodology of the presentinvention, which can be implemented in hardware or software, may ingeneral be adapted to match the requirements of the end customerincluding:

-   -   TV program originators    -   TV program providers    -   TV broadcast distribution    -   Film and Video directors    -   Film and Video studios    -   Film distributors    -   Music program originators    -   Music program providers    -   Music distribution (CD, DVD, Internet)    -   Radio program originators    -   Radio program providers    -   Radio broadcast distribution    -   Computer game originators    -   Computer game providers    -   Computer game distributors    -   Cable and satellite distributors    -   PC manufacturers    -   Professional equipment manufacturers    -   Consumer electronics manufacturers    -   Professional consumer    -   Domestic consumer    -   Home networking equipment manufacturers

With the proliferation of video devices in automobiles and airplanes,systems according to the present invention may also be applied to thesevenues. Thus, in one embodiment, a system according to the presentinvention may down load information regarding the parameters of aparticular audio or video presentation and adjust the output streams inaccordance with these parameters and the known characteristics of theparticular automobile, the audio/video equipment in the automobile, andother variables such as travelling speed, cabin noise, etc. A systemaccording to the present invention may also:

-   -   Maximize the performance of all components within the car's        electronic ‘network’ by creating a reference standard by which        the components must perform, with respect to the current and        future THX Specification standards.    -   Download new settings for component replacement &/or upgrades in        after market segment.    -   Dynamically adjustable compensation for road, wind, and motor        noise contaminating the passenger compartment.    -   Compensation for the change in perceived frequency response in        relation to volume settings with adaptive frequency response        curves.    -   Selecting the appropriate Digital Signal Processing according to        the artists intentions.    -   Link ‘smart’ components such as cellular phones, GPS devices,        video games, and other video devices to maximize the        inter-operative performance.    -   Ease of use through a ‘one button’ reset to reference standards        set by THX and the artist's preferences.

Video benefits include:

-   -   Dynamic adjustment of video display relative to ambient light        within the vehicle to adjust contrast and brightness of the        viewing device.    -   Resolution adjustment for high resolution DVD and lower        resolution video game play to stabilize color and clarity.

A system according to the present invention may thus be configured toprovide:

-   -   A means for protecting the artistic intent of the program        originators;    -   Quality assurance procedures for all media origination        (Film/Broadcast/Video Production/Music Recording);    -   Quality assurance procedures for distribution systems        (DVD/Satellite/Cable/Broadband Internet);    -   Real-time monitoring of hardware and software for digital cinema        and broadcasting;    -   Auto-setup of audio and video replay for the home user;    -   Power saving strategies for minimizing the power consumption of        line or battery operated equipment;    -   Auto-setup for digital cinema and broadcast hardware; and    -   The means, for domestic or professional users, of automated        modifications to the audio data-stream, to prevent audible        distortion or equipment damage during playback.

Benefits of a system according to the present invention may also extendto equipment manufacturers, venue operators, consumers, as well as theartistic community. Equipment manufacturers can guarantee the colorfidelity of images displayed using their projectors if the projectorsincorporate technology according to the present invention, regardless ofthe venue they will be used in. Furthermore, field service requests forcalibration and alignment of the equipment may be sharply reduced.

To the creative community, the benefits are somewhat more subjective,and may include:

-   -   A movie may look the same in every theatre. Feedback from the        actual screen image may allow the projector to compensate for        color variations due to the lamp reflectors, lenses, screen        aging, and the like, and even for lamp aging to a certain        extent. Beyond the lamp age limits, the system may report the        low light level and flag it as a problem to be fixed.    -   A movie may look the same on projectors using different display        technologies. An image adjuster according to the present        invention may manipulate the incoming image data for each        projector technology so that it looks the same on the screen.    -   A movie may look the same in the future as it does now,        regardless of any changes in display standards. A metadata        carried with the image files may define the color standard under        which the image was mastered and displayed originally. Even when        color standards change, an image adjuster according to the        present invention may adapt the projector back to the original        color space for the movie being displayed.    -   The color rendition of the projector can be manipulated to        better achieve a certain “look.” Just as some film is processed        differently to achieve a special look (such as bleach bypass), a        digital projector can be aligned to render images otherwise not        easily achieved, thus affording more creative freedom.    -   The director can change his mind: the color of the movie can be        changed after the data files are delivered to the theatre. A new        color matrix reflecting the director's current wishes can be        downloaded over a network connection, such as the Internet, to        the projector at any time before, during, or after a showing.    -   The color can be changed dynamically during the showing. This        could be used to implement the above-mentioned “look” in only        certain scenes in the movie.

Consumer benefits may include:

-   -   Easily perceived quality difference;    -   Easy to setup;    -   Easy to use;    -   Easy to confirm correct operation;    -   Easy to upgrade;    -   Increased reliability;    -   Consistent product performance;    -   Increased product versatility;    -   Increased performance/price ratio;    -   Increased battery life for portable audio amplifiers; and    -   Higher performance portable audio equipment.

provide a method of maintaining the program creators intention and artthrough the encoding at capture of the signal, then through activecontrol and compensation of the delivered program material in thefollowing areas of display; Post Production, Digital Cinema, Broadcast,Pay Per View, Digital Download, Data Conversion, Optical Media, Internetdelivery and other methods of delivery of audio and/or video.

A home presentation system may consist of components such as Audio/VideoReceiver, Optical Disc player such as DVD, various types of receivingterminal type devices such as cable or DBS receivers, and a Videodisplay device which may be of various technologies such as direct viewCRT, rear screen projection, front projection, plasma screen and LCDprojection. A display alignment system according to the presentinvention may provide a method and technologies which integrate intovarious home devices which allow the adjustment of sound and or displayparameters such as the color balance of the various display systems tomaximize the benefit of the application of the methods and apparatus ofthe present invention to the creation and distribution of audio visualworks.

Referring now to FIG. 5, entertainment system 38 according to thepresent invention may include a sensor 92 to be integrated in a homeentertainment system remote control 40 which may provide a feed backmechanism to a programmed test sequence 42 or other look up system 44built into the display device 46 or other system element 48. Performanceparameters of the system such as the light levels detected by the sensorwould be communicated via an RF or IR digital code 39. Sound fromreproduction elements 47 may also be detected. This system can beintegrated with manual tuning as well to insure all parameters are met.This part of the system is to establish a display result to a knownsource signal internal in the display device.

Another part of this system is to establish a desired result from thevarious system devices such as DVD players and other system elements.For example, in DVD player 49, video level alteration may be possible aspart of feature set 41. A DVD player or other system device according tothe present invention may auto adjust to insure an optimum setting ismaintained during a playback of file or media such as DVD 43 encodedwith test parameters 45 or other standard. A similar set of signals canbe generated from the output of the DVD, cable or DBS set top box andany other type of terminal equipment to provide the adjustment of inputlevels either at the output of the individual device, A/V receiver, orat the Monitor input using the same light sensor contained in the remotecontrol unit.

The intent is not only to provide a display adjustment provision, but toalso include a method to utilize the same device to achieve a systemwide approach. This would involve integrating these technologies intoeach device mentioned as part of the overall technique. Thus sound andpossibly ambient lighting control may also be included.

Referring now to FIG. 6, a digital test program added to a digital mediasuch as DVD may include test election element 50. Element 50 may be usedto initiate a calibration test process to adjust one or more of playbackelements XX-XX. Any other suitable method or device may be used toinitiate a playback calibration.

Referring to FIG. 7, a playback calibration according to the presentinvention may include one or more elements. In a currently preferredembodiment of the present invention a playback calibration includes avideo calibration and an audio calibration. Using a test selection menusuch as menu 52 each test element may be selected using test selectors54 and 56.

Video calibration according to the present invention may includemultiple elements. Referring now to FIG. 8, a first element of a videocalibration may include aspect ratio test and setting. In a currentlypreferred embodiment of the present invention window 58 is used toprompt a user to adjust the aspect ration of the playback system. Videocalibration may also include calibration of other characteristics of thevideo display such as calibration of brightness, contrast, color orchroma, and tint or phase. In a currently preferred embodiment of thepresent invention brightness, contrast, color and tint are calibrated.

Referring now to FIG. 9, a window such as window 60 may be used toprompt a user to adjust video controls to calibrate selected aspect ofthe video display. Window 60 may be used to prompt a user to adjustbrightness, contrast, or tint and color. Tint and color may be adjustedusing a combined window. In a currently preferred embodiment of thepresent invention the order of calibration should be contrast first,brightness second, and then either tint or color.

Sound calibration may also include multiple elements or calibrationtests such as channel volume tests, phasing tests and crossover tests.Referring now to FIG. 10, a window such as window 64 may be used toinitiate audio tests. Selection of test start element 66 may initiate atest sequence. Channel volume tests may test each channel of theplayback system to calibrate the volume.

Referring now to FIG. 11, a calibration window 68 according to thepresent invention is shown. Calibration window may containrepresentations of audio playback elements such as elements 70, 71, 72,73, 74 and 75. Upon initiation of a calibration, a sound or series ofsounds may be reproduced using one or more of as elements 70, 71, 72,73, 74 and 75 and a user may be prompted to perform adjustmentsaccording to characteristics of the sound perceived by the user. Thecharacteristics may include absolute sound level, relative sound level,and relative phasing. Additionally a crossover calibration may beperformed. In a currently preferred embodiment of the present inventiona crossover calibration is performed between 20 and 200 Hz.

Referring now to FIG. 12, a calibration window 76 may include one ormore user prompt messages 78 to indicate suboptimal performance and/orto suggest correction measures.

Referring now to FIG. 13, scene to be captured 110 is illuminated and animage capture devices such as film camera 111, video camera 113 orcapture box 115 may capture reflected light 117 and generate an imagetherefrom on image storage media such as film 112, video tape 118 anddigital media 121 respectively. Alternatively, scene to be captured 110may be an artificial scene 110A, such as a computer generated andrendered scene, which may be stored directly on some media, such asdigital media 121. The intensity of reflected light 117 may becontrolled by exposure controls, such as aperture 115A and shutter 115S.Different capture devices may use different techniques to control theintensity of captured light 117C at capture point 115P. Film camera 111captures images on film 112 which includes one or more images such asimages 112A, 112B and 112C for processing. Input image conversion 114Ais performed by converter 114. During input processing such as inputimage conversion 114A, an image such as image 112A is digitized andnormalized to counteract the input transform function of the imagecapture or generation device such as film camera 111 and the storagemedia used. Once an image is normalized, the resulting intermediateformat file 130 may be stored in computer memory 138 and may bemanipulated using computer 140, display 142 and one or more user inputdevice such as user input device 144.

When an image or images are to be output, an output conversion 147 maybe applied to the intermediate format file 130 of the desired image orimages. The output conversion is applied by output converter 146. Insome cases, output conversion 147 is the inverse of an input conversionsuch as input image conversion 114A used to counteract the capture mediainput transfer function. By using an intermediate format file such asintermediate format file 130 and controlling the conversion of outputfile 149, images captured or originating on disparate media may bereadily combined and may also be transferred to completely differentmedia such as film negative stocks 136, 157 or film print stock 159, orvideo tape 161 or digital storage media 163 or other display media 165while maintaining the fidelity of the image or images.

Image capture media and devices, such as film 112, video camera 113 orcapture box 115, have a transform function that may be measured.Similarly, artificial image creation and rendering techniques anddisplay devices include one or more transform functions. The transformfunction is a measure of the response of the device such as film 112 tothe intensity of captured light 117C, or it may be a measure of theinput or driving voltage or digital value necessary to develop an imagebrightness for image display devices. According to the presentinvention, the process of reversing the transform function of a capture,creation, storage or media element is image conversion as practiced byconverter 114.

Referring now to FIG. 14, an image transform function as used by thepresent invention is shown. By following a reverse transform of theconventional transform of light to film density, the present inventionmay use the captured scene light intensity to scale intermediate imagefiles such as intermediate format file 130.

Image capture, creation and storage is generally accomplished usingmultiple image component channels such as a red channel, a green channeland a blue channel in a conventional RGB system. Other image componentchannel techniques such as YUV or other multi-spectral schemes may beused with the present invention.

For example, in a conventional RGB system, a red channel 120 of image112A may have a point 122 with an image density 124 which may be reversetransformed through response curve 126 of the device, such as filmcamera 111 used to capture or create image 112A, to show that at point122 in the scene to be captured, captured light 117C had intensity 128at capture point 115P. By using response curve 126 in reverse,intermediate format file 130 may be a direct representation of reflectedlight 117. Thus, if an image of scene A having captured light intensityX is fixed on a first media and digitized according to the presentinvention, the digital file would have a file brightness factor Y. Animage of scene B having captured light intensity 2X is fixed on a secondmedia and digitized according to the present invention would have a filebrightness factor twice as large as the brightness factor of scene A, ortwo times Y. Transform characteristics such as FIG. 2 may be obtainedfrom the media manufacturer or by testing. Testing may yield moreaccurate results.

The exposure characteristics of film stocks and video CCDs and otherimage capture devices and the display characteristics of image displayand creation devices may be mapped to a intermediate digital imageformat in such a way that regardless of how an image is captured,created, or stored, a unique intermediate digital image or file iscreated that has a direct relationship to the captured or virtual scenelight intensity. Digital files such as intermediate format file 130 areDigital Intermediate Media Elements or DIMEs. Since a Dime is a mappingof the actual captured scene light intensity or virtual scene lightintensity such as the intensity of reflected light 117, a film negativeor other image storage media produced from a DIME such as negative 136becomes identical to the original image on the original storage media,negative 112.

Referring now to FIG. 15, an image originally captured on video tape 140may be scanned at step 176, undergo reverse transformation 148 andproduce intermediate format file 150. Similarly, output files 152 of acomputer graphics renderer may be mapped at step 178 to produceintermediate format file 154 and negative stock 156 may undergodigitization 158, reverse transformation 160 and produce intermediateformat file 162. Intermediate format files 162, 150 and 154 may becombined and manipulated easily due to their common linearcharacteristics and the combined results may be output through atransform 170 to the corresponding media such as negative 166. Further,the digital input scanner such as digitizer 158 and the output recordersuch as recorder 180 may be calibrated to allow scanning in one filmnegative stock 156, recording to a second negative stock 166, therebycreating a new negative of identical printing density to negative stock156.

An intermediate format file, such as intermediate format files 162, 150or 154, may use any binary format. In a currently preferred embodimentof the present invention, a DIME uses 16 bit numbers for efficiencyrunning on a computer such as computer 140. Eight bit numbers may alsobe used, where processing and storage overhead are not limited orabsolute precision is required. Alternatively, 32 bit, 64 bit or largernumbers may be used to yield greater precision. Color correction isanother facet of image production that is affected by the presentinvention. Color correction may easily be accomplished by manipulatingintermediate format files, such as intermediate format files 162, 150and 154. This technique is performed on digitized files and as such datadiscarded may not be recovered. In a currently preferred embodiment ofthe present invention, color correction is performed on source imagessuch as negative 156 and video 140 to yield a intermediate format filehaving maximum detail.

Further, all analog and digital paths from film scans to an intermediateformat file, and output paths from an intermediate format file to a filmnegative such as negative 166, as well as film projection, CRT displayand electronic projection are corrected in a way that alters the dataonly on the path from the film scanner to the intermediate format fileand on the path to the film recorder, to the workstation displaymonitor, or to the video display system. The technique for this includespassing data both through hardware and software lookup tables. Further,the lookup tables employ independent correction for each of the multipleimage component channels such as the three RGB color channels and may beeither linear, non-linear, matrix, lattice or some other transform orcombination of transforms as required.

Referring now to FIG. 16, in another embodiment of the present inventionthe digitization of the capture device and the reverse transformation ofthe capture media may be included in a digital capture device 116. Theoutput of digital capture device 116 is intermediate format file 172which may be output or stored in any conventional digital manner. Byincluding digitization and reverse transformation in capture device 116,intermediate format file 172 may directly represent light intensity 134reflected by the scene to be captured 132.

Referring now to FIG. 17, still another embodiment of the presentinvention provides a technique for previewing an image on a second mediaas it will appear as if embodied in a first media. The simulationtechnique derives from the reverse transforms described above. Byidentifying media transform characteristics such as those of FIG. 14,intermediate format files such as intermediate format files 162, 150 and154 may be transformed for output to various media such as film negative166 of FIG. 15. The final output or target image of intermediate formatfile 150 may be applied to film negative 166, but during the productionprocess it is desired to preview the image represented by intermediateformat file 150. The preview is displayed on computer display 142.Intermediate format file 150 may be transformed by the transform curvefor film negative 166 and then simulation 174 of the screen image forviewing on a computer display is accomplished by transforming targetimage 176 by the transform characteristics of display 142.

Referring now to FIG. 18, in another aspect of the present invention, atechnique is provided to permit intermediate format file 182, targetedto display on film or a workstation, to be transformed at 184 for thetarget media. Simulation transformation of target image 188 isaccomplished at step 186 to permit the image to be previewed on videotape 190 with the characteristics of target image 188. Transforms suchas transform 184 and simulation transform 186 may include the transformsof film negative stocks and print stocks, as well as the displaycharacteristics of display devices and their phosphor such as display142. Also mapped are graphics display interfaces, RGB frame buffers, YUVframe buffers, component digital video monitors and any other elementsof image capture or display that transform the image. Transform 184 andsimulation transform 186 are separated here for clarity of explanation.In practice, transform 184 and simulation transform 186 may beconcatenated for computational efficiency.

Having now described the invention in accordance with the requirementsof the patent statutes, those skilled in this art will understand how tomake changes and modifications in the present invention to meet theirspecific requirements or conditions. Such changes and modifications maybe made without departing from the scope and spirit of the invention asset forth in the following claims.

1. A method of presenting an audio visual work comprising: capturingaudio-visual content; capturing data representing first characteristicsof the content; combining the content and the captured data as enhancedcontent; using the captured data to process the enhanced content toproduce final content having second characteristics; displaying thefinal content; and using the captured data to adjust the display of thefinal content to reproduce the second characteristics. 2-20. (Canceled)